{"id":37788,"date":"2011-11-01T22:20:01","date_gmt":"2011-11-01T22:20:01","guid":{"rendered":"https:\/\/www.vmengine.net\/2011\/11\/01\/sgi-apache-hadoop-terasort-benchmark-new-world-record\/"},"modified":"2025-05-23T17:10:59","modified_gmt":"2025-05-23T17:10:59","slug":"sgi-apache-hadoop-terasort-benchmark-new-world-record","status":"publish","type":"post","link":"http:\/\/temp_new.vmenginelab.com\/en\/2011\/11\/01\/sgi-apache-hadoop-terasort-benchmark-new-world-record\/","title":{"rendered":"SGI &amp; Apache Hadoop : Terasort Benchmark &#8211; new world record"},"content":{"rendered":"<p>The Cloudera distribution that includes Apache Hadoop was found to be<br \/>\n81% faster than Oracle Sun X2270 cluster<\/p>\n<p>Fremont, Calif. \u2013 October 17, 2011 \u2013 SGI, the leader in technical computing, today announced that it has set a new world record on the Terasort Benchmark for processing and analyzing data using Apache Hadoop clusters running on a Cloudera Distribution (CDH). The company, which recently joined the Cloudera Connect Partner Program, also separately announced that it has formed a distribution relationship with Cloudera that will allow it to build, sell and deploy commercial Hadoop-based solutions.<\/p>\n<p>Results achieved in September 2011 show that 20 SGI Hadoop Cluster nodes composed of SGI Rackable C2005-TY6 half-depth servers with Intel \u00ae Xeon E5630 series processors, 48GB of memory, and 4x 1TB SATA HDDs running on the Cloudera CDH3 took only 130 seconds to complete a Terasort with a working size of 100 GB. Terasort helps derive the sort time for 1TB or any other amount of data in a Hadoop cluster, and is a benchmark that combines the HDFS and MapReduce test layers of a Hadoop cluster. In this case, Terasort scales super-linearly on a Rackable SGI C2005-TY6 cluster with Cloudera&#8217;s Apache Hadoop deployment (CDH3u0), and has been shown to be 81% faster than a similarly sized Sun Oracle X2270 cluster.<\/p>\n<p>Source : http:\/\/www.sgi.com\/company_info\/newsroom\/press_releases\/2011\/october\/hadoop.html<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Cloudera distribution that includes Apache Hadoop was found to be 81% faster than Oracle Sun X2270 cluster Fremont, Calif. \u2013 October 17, 2011 \u2013 SGI, the leader in technical computing, today announced that it has set a new world record on the Terasort Benchmark for processing and analyzing data using Apache Hadoop clusters running [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":28795,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2297],"tags":[2294,559,2295,124,2296,1594,131,228,2110,2298],"class_list":["post-37788","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-en","tag-benchmark-en","tag-case-study-en","tag-cloudera-en","tag-grid-computing-en","tag-hadoop-en","tag-sgi-en","tag-stories-en","tag-technical-en","tag-technologybiz-en","tag-terasort-en"],"aioseo_notices":[],"jetpack_featured_media_url":"http:\/\/temp_new.vmenginelab.com\/wp-content\/uploads\/2011\/11\/sgi-hadoop1-1.png","amp_enabled":true,"_links":{"self":[{"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/posts\/37788","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/comments?post=37788"}],"version-history":[{"count":1,"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/posts\/37788\/revisions"}],"predecessor-version":[{"id":41099,"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/posts\/37788\/revisions\/41099"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/media\/28795"}],"wp:attachment":[{"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/media?parent=37788"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/categories?post=37788"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/temp_new.vmenginelab.com\/en\/wp-json\/wp\/v2\/tags?post=37788"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}